IMAGE PROCESSING METHOD, RELATIVE DENSITY DETECTING METHOD 
AND IMAGE PROCESSING APPARATUS 



FIELD OF THE INVENTION 

The present invention relates to an image processing 
method and an apparatus thereof, which binarize a multi- 
valued image having depth, more particularly to an image 
processing method and an apparatus thereof, which exert per- 
formance for cutting out characters and the like. 



BACKGROUND OF THE INVENTION 

Recent years, a digital camera and so on have been 
developed, thus a request has been increased such that a 
large number of images, each of which includes a large num- 
ber of character images such as those on a white board used 
at a conference and on a time table, should be taken into 
photographs and stored, and later, character information and 
the like should be read out from the photograph information. 
Such a photograph image by a digital camera is a multi- 
valued image having depth. If image information of the 
multi-valued image is stored as it is and outputted accord- 
ing to needs, it is possible to read out the character 
information and the like from the photograph information of 
the multi-valued image. 

However, the multi-valued image has a large amount of 
information, and storing the image information requires an 
enormous amount of memories. For a request to simply read a 
character, it is not preferable that the multi-valued image 
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1 is stored in memories as it is, and it is desirable that 

2 this multi-valued image is binarized to be stored in the 

3 memories. Such binarization of a multi-valued image having 

4 a depth is required for not only the foregoing example but 

5 also various other applications. For example, the binariza- 

6 tion is required for the case where an image is reduced in 

7 size to be stored, the case of performing pre-processing 

8 made for recognizing an object in an image such as a charac- 

9 ter, the case of obtaining a special image processing effect 
10 (such as a woodcut print image) and so on. As principal 

binarization methods, there have conventionally existed a 
simple binarization method, an edge emphasis binarization 
method, a binarization method designed to pursue photograph 
quality as much as possible by using a binary printer driver 
'fl 15 program and so on. 

j 16 Moreover, in a gazette of Japanese Patent Laid-Open No. 

*S 17 Sho 63-108470, in consideration of a defect that the sphere 
% 18 of characters or figures whose binarized images may be suf- 
ficient is stored as multi-valued data, a technology is 
i 20 disclosed, in which information for classifying spheres into 

21 respective spheres to be saved as binary data and multi- 
la 22 valued data is added to image data and stored, thus the 
f 23 image data is stored in a small volume. Furthermore, in a 

24 gazette of Japanese Patent Laid-Open No. Hei 5-225388, a 

25 technology is disclosed, in which each pixel is filtered 

26 depending on a change of image densities of pixels existing 

27 on a periphery thereof to smoothen and thin image data, thus 
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pre-processing is executed for enhancing clearness of an 
image to perform character recognition and so on. 

However, the simple binarization method as described 
above is hardly used actually, though it is very simple. 
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1 For example, if in an image,, there are dark and bright por- 

2 tions that are mixed with each other, it often occurs that a 

3 density of a character existing in the bright portion is 

4 brighter than a background in the dark portion. For this 

5 reason, with this simple binarization method, there remain 

6 unsolved problems that an outline of a character or an 

7 object in the bright portion or the like is faded and that 

8 an outline of a character or an object in the dark portion 

9 or the like turns solid black together with a background. 
Moreover, the edge emphasis binary method cannot deal with a 
character having, for example, a blurred outline, therefore 
this method cannot be used for character recognition and the 
like. Furthermore, the binarization method designed to pur- 

O 14 sue photograph quality as much as possible by using a binary 
iSs 15 printer driver program provides the most natural image 
■■f 16 exhibiting good quality when viewed as a photograph by a 
J 17 person, but this method is not suitable for character recog- 
W 18 nition and cannot be used for the purpose of reducing a data 
^ 19 volume to a great extent. Furthermore, in the prior arts 
5 20 described in the gazettes of Japanese Patent Laid-Open No. 
Sho 63-108470 and Hei 5-225388, a calculation amount is 
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W 22 enormous and image processing to a great extent is required. 

Ill 

jl 23 Accordingly, the image processing using the binarization 

24 methods cannot be achieved with a simple system constitution 

25 by these prior arts, and it is difficult to attain high- 

26 speed processing therewith. 

27 SUMMARY OF THE INVENTION 

28 The present invention was made in order to solve the 

29 forgoing technical subjects. An aspect of the present 
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1 invention is to provide an image processing apparatus, which 

2 cut out, for example, a character and the like written with 

3 a pen and so on, the character being relatively darker than 

4 a background, at a high speed. 

5 Another aspect of the present invention is to provide 

6 an image processing apparatus and the like, which emphasize 

7 an object without performing character recognition to com- 

8 press an image size without damaging understandability of 

9 the object. 

10 It is still another aspect of the present invention to 

11 obtain binary data, which has a small number of step differ- 

12 ences and is smooth and high quality, even in the case where 

13 a background density is referred in an attempt of high-speed 
;^ 14 processing. 

|3 15 In order to achieve the foregoing aspects, according to 

the present invention, an image processing system used for 
pre-processing for cutting out a character and the like is 
provided, in which attention is paid to that a character 
written with a pen and so on is relatively darker than a 
background, a relative density of such a character to a 
fi 21 periphery thereof is obtained and then the obtained relative 
density is binarized, and thus an object such as a character 
is emphasized and a background is brightened. Specifically, 
an image processing method, to which the present invention 
is applied, comprises the steps of: meshing an inputted 
image into sub images, each of which has a specified size 
and, for example, has a rectangular area to divide the 
inputted image into pixel groups; calculating a pixel group 
density for each of the divided pixel groups; and calculat- 
ing an output value of a certain watched pixel based on an 
absolute density of the watched pixel and a relative density 
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for the watched pixel, the relative density being calculated 
based on the pixel group density of the pixel group, to 
which the watched pixel belongs, and the pixel group density 
of the pixel group adjacent to the pixel group, to which the 
watched pixel belongs, among the pixel groups in the image. 

BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the present inven- 
tion and the advantages thereof, reference is now made to 
the following description taken in conjunction with the 
accompanying drawings . 

Fig. 1 is an explanatory view showing an entire consti- 
tution of an image processing apparatus according to this 
embodiment . 

Fig. 2 is a flowchart explaining a processing flow of 
an image processing system according to this embodiment. 

Fig. 3 is a view showing a constitution of a function 

used in this system. 

Figs. 4 (a) and 4 (b) are views respectively showing an 
idea when obtaining a relative value and a trapezoidal func- 
tion when obtaining a weight coefficient. 

Figs. 5 (a) to 5 (d) are views showing image histograms 
representing the functions used in this system shown in Fig. 
3. 

Figs. 6 (a) and 6 (b) are views showing examples of 
image processing performed for images of time tables photo- 
graphed by a digital camera. 

Figs. 7 (a) and 7 (b) are views showing examples of 
image processing performed for the images of the time tables 
photographed by a digital camera. 
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1 Figs. 8 (a) and 8 (b) are views showing examples of 

2 image processing performed for photographs of a dining table 

3 taken by a digital camera. 

4 Fig. 9 is a view showing an example of image processing 

5 performed for the photograph of the dining table taken by a 

6 digital camera. 

7 DESCRIPTION OF THE INVENTION 

8 Herein, "pixel group density" is a concept including 

9 not only an average density of a pixel group described in 
the embodiment but also a density of a typical pixel, for 
example, a typical density in a pixel range having the larg- 
est number of pixels. In this case, the typical density is 
obtained by setting a specified number of density ranges and 
obtaining a number of pixels entering each of the ranges. 

Herein, the relative density may be calculated by use 
of an influence degree calculated based on a distance from 
the watched pixel and the pixel group, to which the watched 
pixel belongs, to the pixel group adjacent to the pixel 
group, each of the adjacent pixel group being located on and 
0 20 under and at the right and left of the pixel group. Moreo- 
j ~ 21 ver, in the step of detecting the pixel group densities, an 

22 average density of the divided pixel group may be 

23 calculated, and the relative density may be calculated by 

24 multiplying the respective average densities of the pixel 

25 group, to which the watched pixel belongs, and of the pixel 

26 group adjacent to the pixel group, to which the watched 

27 pixel belongs, by the respective influence degrees. Fur- 

28 thermore, the relative density may be calculated based on an 

29 influence degree obtained by a trapezoidal function 
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1 representing a positional relation between a coordinate 

2 position of the watched pixel and the pixel group adjacent 

3 to the pixel group, to which the watched pixel belongs. 

4 Conventionally, it has taken an enormous processing time to 

5 calculate an average density of a periphery of a pixel, for 

6 example, of the vicinity of_NXN, for each pixel in which a 

7 relative density thereof is obtained. However, with the 

8 above-described constitution, it is possible to execute 

9 high-speed processing and to obtain an output image with a 
10 quality hardly deteriorated. 

Moreover, if the output value is calculated only with 
the relative value, for example, it may sometimes occur that 
values in both an entirely bright portion and an entirely 
dark portion are equal to each other. In this case, an 
i 15 image of a bright portion may be black, and an image of a 
J 16 dark portion may be white. However, in the step of calcu- 
'S 17 lating this output value, the relative and absolute 
| 18 densities may be weighted to calculate the output value, 

19 thus it is possible to emphasize an object while maintaining 

P 

s p 20 a feature of an original image. 

ill 21 On the other hand, according to the present invention, 

Q 22 a relative density detecting method for detecting a relative 
l * 23 density of a watched pixel constituting an inputted image 
comprises the steps of: dividing the image into pixel 
groups, each of which has a specified size; detecting a 
pixel group density for each of the divided pixel groups; 
extracting positional information for the watched pixel in a 
pixel group including the watched pixel; and detecting a 
relative density of the watched pixel based on the pixel 
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1 Moreover, an absolute density of this watched pixel may 

2 be detected, and a relative density may be detected, which 

3 is obtained by adding a value obtained by multiplying a 

4 pixel group density by a weight of positional information to 

5 the detected absolute density. Thus, a step difference does 

6 not occur in a portion in which a density varies smoothly, 

7 and it is possible to represent a smooth density change in 

8 the output image. 

9 Furthermore, a weight of this positional information 
may be calculated by applying a trapezoidal function repre- 
senting a positional relation between a position coordinate 
of the watched pixel and the pixel group adjacent thereto to 
extract this positional information. In such a manner, sim- 
plifying of the calculation is enabled, and this is 
preferable in that a scale of image processing can be made 

16 small and a processing speed can be accelerated. 
!7 Moreover, in order to achieve the foregoing aspects, 

according to the present invention, an image processing 
apparatus comprises: pixel group dividing means for dividing 
an inputted image into pixel groups, each of which has a 
IV 21 specified size; pixel group density detecting means for 
| 22 detecting a pixel group density for each of the pixel groups 
i* 23 divided by the pixel group dividing means; weight deciding 
24 means for deciding each weight of the pixel groups adjacent 
to the pixel, to which a watched pixel belongs, based on a 
position of the watched pixel to be outputted; watched pixel 

27 density detecting means for detecting a density of the 

28 watched pixel; and relative density calculating means for 

29 calculating a relative density of the watched pixel based on 

30 a detected density of the watched pixel, a pixel group 
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density of the detected pixel group and a decided weight of 
the pixel group. 

Herein, the image processing apparatus may further com- 
prise output density calculation means for calculating an 
output density by performing predetermined weighting for the 
density of the watched pixel detected by the watched pixel 
density detecting means and the relative density calculated 
by the relative density calculating means. With such a con- 
stitution, for example, by properly executing weighting 
based on the rule of thumb, emphasis of an object and out- 
putting of a binarized image added properly with a feature 
of the original image are enabled. 

Moreover, this pixel group dividing means may roundly 
divide an inputted image into meshes, each of which has I 
pixelsxj pixels (I, J: integers) . With such a constitution, 
this is preferable in that calculation for a background den- 
sity can be executed at a high speed. Furthermore, this 
weight deciding means may comprise a table look-up for 
deciding weights of each pixel groups adjacent to a pixel 
group, to which the watched pixel belongs, based on a coor- 
dinate position of the watched pixel. In this case, 
specifically, the pixel groups are located at the right and 
left of the pixel group, to which the watched pixel belongs, 
and/or on and under the pixel group, to which the watched 
pixel belongs. Still further, this weight deciding means 
may add weights of pixel groups located at the right and 
left of the pixel group and adjacent to the same, to which 
the watched pixel belongs, to obtain a sum of 1, and/or may 
add weights of pixel groups located on and under the pixel 
group and adjacent to the same, to which the watched pixel 
belongs, to obtain a sum of 1. With the above-described 
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1 constitution, a simple function can be applied to the meshes 

2 located on and under and at the right and left of the pixel 

3 group, to which the watched pixel belongs, that is, adjacent 

4 thereto. Thus, it is possible to obtain a smooth and high- 

5 quality binarized image. 

6 Furthermore, according to the present invention, an 

7 image processing apparatus for converting image data, which 

8 includes a specified object photographed by a digital 

9 camera, into a binarized image, may comprise: a meshing unit 

10 for meshing the entire image data into sub images; an aver- 

11 age density detection unit for detecting an average density 

12 of each of the sub images meshed by the meshing unit; and a 

13 density detection unit for detecting a density of a pixel 
9 14 constituting the object. In this case, a binarized image, 

|| 15 in which an outline of the object is emphasized, may be gen- 

£ 16 erated based on a detected density of the pixel, an average 

5 17 density of the sub image, to which the pixel belongs, and an 

^ 18 average density of the sub image adjacent to the certain sub 

19 image. With such a constitution, it is possible to obtain a 

20 high-quality binarized image at a high speed, and even in 
l5 21 the case of compressing an image size, it is possible to 

K 22 obtain a binarized image, which can bear comparison with the 

C 23 multi-valued image in readability of an object such as a 

24 character. 

25 DETAILED DESCRIPTION OF THE AD VANTAGEOUS EMBODIMENT 

26 An embodiment of the present invention will be 

27 described in detail with reference to the accompanying draw- 

28 ings below. 
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1 Fig. 1 is an explanatory view showing an entire consti- 

2 tution of the image processing apparatus according to this 

3 embodiment. This image processing apparatus can be consti- 

4 tuted as software, for example, in a personal computer, or 

5 can be constituted as hardware or software, for example, in 

6 a digital camera. Moreover, this image processing apparatus 

7 can be applied as an apparatus of cutting out a character as 
pre-processing for a character recognition apparatus. A ref- 
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inputting color image data of R (red), G (green) and B 
(blue) , and a numeral 12 denotes a gray conversion unit for 
converting color image data inputted from the image data 
input unit 11 into multi-valued gray image data. Image data 
inputted to this image data input unit 11 is, for example, 
S 15 image data read out from an optical image reading apparatus 
such as a picked-up image data with a digital camera, and 
image data read out from a scanner, which is equipped with a 
line sensor in a main scanning direction and scans an image 
in a sub scanning direction to read an image. In this gray 
conversion unit 12, the existing gray conversion system can 
5 21 be employed, in which, for example, each image data of R, G 
and B is subjected to gray conversion and the converted 
image data are added to convert the same into gray image 
data having 256 gray scales from 0 to 255 gray scales. 
Moreover, the image processing may be individually performed 
for each of color signals R, G and B to calculate output 
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finally. Furthermore, in the case where the gray image data 
rather than the color image data is inputted, the gray con- 
version unit 12 may be omitted, and the image processing may 
be performed based on this gray image data. 
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A reference numeral 13 denotes a meshing unit for mesh- 
ing the gray image data (M pixelsxN pixels) converted by the 
gray conversion unit 12 to sub images, each of which has I 
pixelsxj pixels, for example, 10 pixelsxlO pixels. A 
numeral 14 denotes an average density detection unit for 
obtaining an average density in each of the meshes (sub 
images) meshed by the meshing unit 13. A numeral 15 denotes 
an average density storage unit for respectively storing the 
average densities obtained by the average density detection 
unit 14. A numeral 16 is a watched pixel position detection 
unit for detecting that a watched pixel exists in a mesh 
located in an i-th column and an j-th row, for example, from 
a fact that the watched pixel is a pixel in m-th column and 
n-th row, or contents meshed by the meshing unit 13 and the 
like. A numeral 17 denotes an absolute density storage unit 
for storing a density (absolute density) of each of the pix- 
els including the watched pixel. 

A reference numeral 18 denotes a watched pixel weight 
coefficient storage unit for storing an influence degree 
(relative relation) for meshes located on and under and at 
the right and at the left of the watched pixel and at as a 
weight coefficient. For example, if the meshed sub image is 
constituted of 10 pixelsxlO pixels, the weight coefficient 
is stored in a table of the watched pixel weight coefficient 
storage unit 18 as, for example, ten coefficients, that is, 
0.05, 0.15... 0.85, 0.95. A numeral 19 denotes a relative 
density calculation unit for calculating a relative density 
for each watched pixel in consideration of brightness in the 
periphery of the watched pixel based on each of the data 
from the average density storage unit 15 and the absolute 
density storage unit 17 and a weight coefficient read out 
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1 from the watched pixel weight coefficient storage unit 18. 

2 A numeral 20 denotes a weight coefficient storage unit for 

3 storing weight values of the relative and absolute densities 

4 such as a value based on the rule of thumb, for example, 

5 that a weight of the absolute value is reduced to 

6 one-eighth. A numeral 21 denotes an output density calcula- 

7 tion unit for calculating an output density from the 

8 relative density calculated by the relative density calcula- 

9 tion unit 19 based on a weight obtained by the weight 
10 coefficient storage unit 20 and the absolute density of the 

watched pixel read out from the absolute density storage 
unit 17. A numeral 22 denotes an image data output unit for 
outputting an image having a final density calculated by the 
output density calculation unit 21 to a next step thereof 
m 15 such as a memory and printing devices. 

Fig. 2 is a flowchart explaining a processing flow of 
the image processing system according to this embodiment. 
^ 18 First, from a result of the gray conversion unit 12 and the 

like, a gray image having M pixelsxN pixels is obtained 
E 20 (step 101) . This obtained gray image is meshed into sub 

21 images having, for example, 10 pixelsxlO pixels, to form IXJ 
| 22 meshes (pixel group) (step 102). Next, an average density 

23 in each of the meshes is obtained, (step 103). For example, 

24 if the gray image is meshed into 10 pixelsxlO pixels, an 
average value (density) of 100 pixels (=10 pixelsxlO pixels) 
is calculated. Then, an absolute density of each watched 
pixel is obtained (step 104), and by using this absolute 
density, a relative density to five meshes, (mesh including 
watched pixel itself, two meshes on and under the center 
mesh and two meshes at the right and left of the center 
mesh) is obtained for each watched pixel (step 105) . 
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Thereafter, a final density is decided by a function added 
with the absolute and relative densities for each watched 
pixel (step 106) . 

Next, description will be made in detail for a function 
used in this system. 

Fig. 3 shows a constitution of the function used in 
this system. [P]mn shows a final value (density) of a pixel 
located in the m-th column and the n-th row. This final 
value is schematically calculated from a value added with a 
constant C, a value added with the absolute value and a 
value added with the relative value. Specifically, in an 
equation shown in Fig. 3, a first term of a right side 
thereof represents a constant term, a second term thereof 
represents the one obtained by multiplying the absolute 
value by a, and a third term thereof represents the one 
obtained by multiplying the relative value by /?. This third 
term of the right side is added with a relative value given 
in consideration of a mesh itself (in an i-th column and a 
j-th row) and meshes on and under the mesh and a relative 
value given in consideration of the mesh itself and two 
meshes at the right and left sides. Herein, if the final 
value is decided only with the relative values, for example, 
it may sometimes occur that values in both an entirely 
bright portion and an entirely dark portion are equal to 
each other. Thus, there exists a possibility of a result 
which is occurred to be a different image from an actual 
image. For example, an image of a bright portion may be 
black, and an image of a dark portion may be white. For 
this reason, this system is constituted such that the final 
value can be decided by adding the absolute value. 
Moreover, the absolute value Pmn of the watched pixel is 



DOCKET NUMBER: JP920000039US1 



- 14 



i~3 



1 multiplied by the weight coefficient a. In this case, expe- 

2 rientially, the value a is preferably reduced to about 

3 one-eighth. Furthermore, the final value may sometimes fall 

4 in a minus if the absolute value is made small when the 

5 final value is calculated with the relative value. There- 

6 fore, as the constant C, a value, which is decided 

7 experientially so that the final value is not to fall in a 

8 minus, is employed. Note that in this function, an average 

9 density of a mesh image in the i-th column and the j-th row, 

10 to which the watched pixel belongs, is represented as S i/jf an 

11 average density of a mesh image located thereon is repre- 

12 sented as Si-i,j, an average density of a mesh image located 

13 thereunder is represented as S i+1/j , an average density of a 
fcD 14 mesh image located at the left thereof is represented as 

OB 15 S lfj -i, and an average density of a mesh image located at the 

J 16 right thereof is represented as S i/j+1 . Furthermore, a weight 

k Q 17 coefficient of the mesh on the watched pixel is represented 

|{j is as di, a weight coefficient of the mesh at the left thereof 

L 19 is represented as d 2 , a weight coefficient of the mesh at the 

J 20 right thereof is represented as d 3/ and a weight coefficient 

21 of the mesh thereunder is represented as d 4 . 
g" 22 In this function shown in Fig. 3, for example, parame- 

*~ 23 ters may be designated as follows: 

In the original image: C=0, a=l, fi=0; 
in the image only having the relative value: 

26 C=plus value, a=0, /?=plus value; and 

27 in the image added with the absolute value and the 

28 relative value: 

29 C=plus value, a=plus value, /?=plus value. 
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1 With the above designation of the parameters, various 

2 images including an image enlarged in contrast can be formed 

3 at a high speed. 

4 Figs. 4 (a) and 4 (b) are views respectively showing an 

5 idea when obtaining the relative value and a trapezoidal 

6 function when obtaining the weight coefficient. In Fig. 4 

7 (a), as explained with reference to Fig. 3, an average den- 

8 sity of a mesh image in the i-th column and the j-th row, to 

9 which the watched pixel belongs, is represented as S ifj , an 

10 average density of a mesh image located thereon is repre- 

11 sented as Si-i,j, an average density of a mesh image located 

12 thereunder is represented as S 1+ i,j/ an average density of a 

13 mesh image located at the left thereof is represented as 

5 14 Si,j-i/ and an average density of a mesh image located at the 

S3 15 right thereof is represented as S ifj+ i. In this example, the 
watched pixel is located at the upper right position in the 
mesh image in the i-th column and the j-th row. The influ- 
ence degrees (weights) received from the mesh images by the 
watched pixel are as follows. The weight is 1 in the mesh 

20 in the i-th column and the j-th row. Since the watched 

W 21 pixel is located close to the mesh located on the mesh, to 

« 22 which the watched pixel belongs, the weight d : is equal to 

!= 23 0.85 in the mesh in the i-th column and the j-th row. The 

24 weight d 4 is equal to 0.15 in the mesh thereunder. The 

25 weight d 2 is equal to 0.35 in the mesh at the left thereof. 

26 The weight d 3 is equal to 0.65 in the mesh at the right 

27 thereof. Herein, di+d 4 =l and d 2 +d 3 =l, and the mesh has 10 

28 pixelsxlO pixels. Therefore, in consideration of the cen- 

29 ters of the respective pixels, the respective weight values 

30 can take ten values as described above, that is, 0.05, 

31 0.15, . . .0.85 and 0.95. 
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1 The relation of the weight coefficients when obtaining 

2 the relative value can be easily explained with reference to 

3 the trapezoidal function shown in Fig. 4 (b) . In Fig. 4 

4 (b) , an example of obtaining the weights of the mesh images 

5 located at the right and left of the mesh, to which the 

6 watched pixel belongs, by use of the positional relation in 

7 the X-coordinate is illustrated. The upper side of this 

8 trapezoidal function shows a position of the sub area (mesh 

9 image) in the i-th column and the j-th row in which the 

10 watched pixel exists, and a length thereof is 1. The 

11 hypotenuses slant from both ends of the upper side downward 

12 to the right and left directions have a slant, which has a 

13 width of 1 and a height of 1. 

14 Now, the X-coordinate of the watched pixel is assumed 
m 15 as nc, the X-coordinate of the left end of the watched pixel 
jf 16 in the mesh is assumed as nl (X-coordinate of the pixel at 

is 17 the left end in the mesh-0.5), and the size of the mesh 
image is assumed as Sz. In this case, for example, the 
weight coefficient d 2 of the mesh at the left of the mesh in 
the i-th column and the j-th row and the weight coefficient 
d 3 of the mesh at the right of the mesh in the i-th column 
and the j-th row can be obtained in the following equations. 

23 d 2 =l- (nc-nl) /Sz 

24 d 3 = (nc-nl) /Sz 

25 Results obtained from the above equations can be also 

26 obtained from the trapezoidal function shown in Fig. 4 (b) , 

27 that is, d 2 can be obtained from the left hypotenuse and d 3 

28 can be obtained from the right hypotenuse. Note that, simi- 

29 larly to the above, the weight coefficients d x and d 4 of the 

30 mesh images on and under the center mesh can be obtained 

31 from the positional relation of the Y-coordinate . 
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1 In the foregoing manner, the weight coefficients are 

2 previously calculated in this embodiment, and can be easily 

3 obtained by a table look-up while calculating [P]mn. By 

4 obtaining the weight coefficients with the above-described 

5 system, background values as bases for comparison among the 

6 respective pixels at the positions in the meshes can be made 

7 to differ delicately from one to another, thus it is possi- 

8 ble to obtain a smooth image without suddenly bringing about 

9 a great change of the image at a boundary of the meshes. 
Note that although the average density of the four mesh 

images located on and under and at the right and left of the 
mesh in the i-th column and the j-th row is used as the 
relative density of the meshes adjacent to each other, the 
average density of the slant images may be further added as 
long as the processing is permitted to fall a little compli- 
16 cated. 

- H Q ^ Figs. 5 (a) to 5 (d) are views showing image histograms 

representing the functions used in this system shown in Fig. 
3. Fig. 5 (a) shows an original histogram. Fig. 5 (b) 
shows a histogram where the absolute value in the original 
histogram of Fig. 5 (a) is multiplied by a (herein, by 1/8). 
Fig. 5 (c) is a histogram where the relative value obtained 
by the algorithm as described above is added to the histo- 
gram of Fig. 5 (b) . Under the condition that the relative 
value is simply added, the histogram may include a minus 
value in some cases. Therefore, in this embodiment, the 
constant C is added as shown in Fig. 5 (d) to jack up the 
histogram, thus adjusting an output value. 

Next, description will be further made for this embodi- 
ment with reference to output examples. 
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Figs. 6 (a) and 6 (b) and Figs. 7 (a) and 7 (b) show 
examples of image processing performed for images of time 
tables photographed by a digital camera. Note that in these 
views, there appear images, which are against the present 
applicant's will due to conversion at the time of filing the 
present invention. Herein, the parameters of the function 
shown in Fig. 3 are set as follows. 

constant C=64, a=l/8, J3=l 
And the mesh size is set as Sz=8. Fig. 6 (a) shows an image 
obtained by printing an 8-bit multi-valued image so as to 
have high image quality as possible by a printer driver. 
From this image, it is possible to read time data such as a 
character 51 and the like. However, a data volume thereof 
is 51.5kB (tif file compressed with JPEG), which is consid- 
erably large. Fig. 6 (b) shows an image obtained by 
subjecting the original image to the conventional simple 
binarization. In this case, a data volume thereof is 
reduced to 5.0kB (tif file compressed with G4MMR) , which is 
small. However, in this case, there are many characters, 
which can not be read. For example, it is difficult to 
determine the character 51. Moreover, a background 52 also 
appears differently from an actual image thereof to a great 
extent. On the other hand, Fig. 7 (a) shows a binarized 
image obtained by performing relative value calculation 
thereto not by use of the above-described trapezoidal func- 
tion but by use only of the mesh, to which the watched pixel 
belongs. In this case, a data volume thereof is 7.7kB 
(G4MMR) , which is small, and it is possible to read the 
character 51 precisely. Moreover, a background 52 expresses 
a feature of an actual image thereof. However, the back- 
ground 52 is affected by the influence of the boundary of 
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1 the meshes, hence there are some places where unnatural rug- 

2 gedness occurs. Fig. 7 (b) shows a binarized image obtained 

3 by further performing relative value calculation by use of 

4 slope functions of the trapezoids located on and under and 

5 at the right and left of the certain mesh. Herein, a data 

6 volume thereof is 9.7kB (G4MMR) , which is small. Moreover, 

7 ruggedness on the background 52 disappears, hence a consid- 

8 erably natural binarized image is achieved. Furthermore, it 

9 is possible to determine the character 51 sufficiently. 
Accordingly, obtained readability of the character 51 can 

11 even bear comparison with the multi-valued image shown in 

12 Fig. 6 (a) . 

13 Figs. 8 (a) and 8 (b) and Fig. 9 are views showing 

14 examples of image processing performed for photographs of a 

15 dining table taken by a digital camera. Note that, also m 
these views, there appear images, which are against the pre- 
sent applicant's will due to conversion at the time of 
filing the present invention. Fig. 8 (a) is a binarized 
image obtained by processing the taken image into 8-bit 
multi-valued image and then subjecting the 8-bit multi- 
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II 1 21 valued image to an error diffusion method as a prior art. 



Hi 22 In this case, an image size thereof is 62.0kB (G4MMR) , which 

P 23 is large. Fig. 8 (b) shows an image obtained by subjecting 

24 the image of Fig. 8 (a) to the simple binarization . In this 

25 case, an image size thereof is 5.7kB (G4MMR) , which is 

26 small. However, the image is greatly defaced, and it is 

27 hardly possible to determine an outline thereof. On the 

28 other hand, Fig. 9 shows an image subjected to image proc- 

29 essing with the system according to this embodiment. In 

30 this case, an image size thereof is 15.0kB (G4MMR) , which is 

31 relatively small. Moreover, it is possible to clearly 
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express existence of objects. Accordingly, an artistic 
image can be obtained, and it is possible to utilize the 
image as a rough copy for a woodcut print . 

As described above, with the image processing method 
according to this embodiment, image processing is performed 
by properly combining the absolute value and the relative 
value, thus the image processing method can be used for 
various purposes such as pre-processing for cutting out an 
object including a character, storing memo data on a white 
board, a time table of a bus service and the like, making a 
rough copy for a woodcut print. With the image processing 
method, extraction of a character can be achieved with a 
high quality. Accordingly, it is possible to apply the 
image processing method, for example, to pre-processing for 
an automatic reading system of postal matters' addresses. 
Moreover, with this image processing method, it is possible 
to reduce an image size to about 1/5 compared with that of 
the 8-bit multi-valued image. Accordingly, a great effect 
can be obtained, for example, in the case where a large 
amount of images photographed by a digital camera are 
desired to be stored. Furthermore, since the image process- 
ing method is realized by use of a simple function, the 
image processing can be carried out at a high speed, and 
nevertheless, a binarized image having a high quality can be 
obtained. 

Moreover, there may be provided a user interface for 
allowing the equation shown in Fig. 3 to change. Thus, 
adjustment can be performed so as to correspond to a charac- 
teristic of an image to be processed, for example, an image 
having overall a small (or large) contrast, an image having 
a character or an object desired to be determined, which has 
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such as the multidimensional function and the trigonometric 
function. 

As described above, according to the present invention, 
it is possible to cut out a character and the like at a high 
speed, which are written with a pen and so on the character 
being relatively darker than a background in a multi-valued 
image, to use the cutting-out of a character for pre- 
processing for character recognition and the like, to 
emphasize an object such as a character and a figure, and to 
compress an image size without damaging understandability of 
the object. 

The present invention can be realized in hardware, soft- 
ware, or a combination of hardware and software. The present 
invention can be realized in a centralized fashion in one 
computer system, or in a distributed fashion where different 
elements are spread across several interconnected computer 
systems. Any kind of computer system - or other apparatus 
adapted for carrying out the methods described herein - is 
suitable. A typical combination of hardware and software 
could be a general purpose computer system with a computer 
program that, when being loaded and executed, controls the 
computer system such that it carries out the methods 
described herein. The present invention can also be embedded 
in a computer program product, which comprises all the fea- 
tures enabling the implementation of the methods described 
herein, and which - when loaded in a computer system - is 
able to carry out these methods. 

Computer program means or computer program in the pre- 
sent context mean any expression, in any language, code or 
notation, of a set of instructions intended to cause a system 
having an information processing capability to perform a 
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particular function either directly or after conversion to 
another language, code or notation and/or reproduction in a 
different material form. 

It is noted that the foregoing has outlined some of the 
more pertinent objects and embodiments of the present inven- ' 
tion. This invention may be used for many applications. 
Thus, although the description is made for particular 
arrangements and methods, the intent and concept of the 
invention is suitable and applicable to other arrangements 
and applications. It will be clear to those skilled in the 
art that other modifications to the disclosed embodiments can 
be effected without departing from the. spirit and scope of 
the invention. The described embodiments ought to be con- 
strued to be merely illustrative of some of the more 
prominent features and applications of the invention. Other 
beneficial results can be realized by applying the disclosed 
invention in a different manner or modifying the invention in 
ways known to those familiar with the art. 

Thus, although the advantageous embodiments of the pre- 
sent invention have been described in detail, it should be 
understood that various changes, substitutions and alterna- 
tions can be made therein without departing from spirit and 
scope of the invention as defined by the appended claims. 
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